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59. (Amended) A reduced com&lexity sequence estimator for processing a multi- 
dimensional signal received from channel having a\hannel memory, comprising: 
a prefilter to shorten a channel memo? 
a branch metrics unit for precomputing &ne-dimensional branch metrics for possible 
values of said shortened channel memory and for each qtmension of the multi-dimensional signal; 

means for combining said one-dimensiqpal branch metric into at least two- 
dimensional branch metrics; and 

a multiplexer for selecting one of said at least t^vo-dimensional branch metrics based 
on at least one decision from at least one corresponding state.. 



REMARKS 



The present application was filed on December 23, 1999 with claims 1 through 59. 
Claims 1 through 59 are presently pending in the above-identified patent application. Claims 1, 2, 4, 
7, 1 1-22, 24, 31, 36-38, and 47-59 are proposed to be amended herein. 

15 In the Office Action, the Examiner required restriction to claims 1-38 and 47-59 or 

claims 39-46 under 35 U.S.C. 121. The Examiner also objected to the Abstract because it contains 
more than 150 words. The Examiner rejected claims 2, 14 and 19 are rejected under 35 U.S.C. 1 12, 
second paragraph, as being indefinite for failing to particularly point out and distinctly claim the 
subject matter which applicant regards as the invention. The Examiner indicated that claims 1, 3-13, 

20 15-18, 20-38, and 47-59 are allowed and indicated that claims 2, 14, and 19 would be allowable if 
rewritten to overcome the rejections under 35 U.S.C. 1 12, second paragraph, set forth in this Office 
Action and to include all of the limitations of the base claim and any intervening claims. 
Elections/Restrictions 

The Examiner indicated that restriction to one of the following inventions was 
25 required under 35 U.S.C. 121 : 

I. Claims 1-38 and 47-59, drawn to a reduced complexity sequence estimation, 
classified in class 375, subclass 341. 

II. Claims 39-46, drawn to memories for storing and transferring data, classified in 
class 711, subclass 1 00. 

11 




Azadet 10-2 

Applicants hereby elect the claims of Group I with traverse and withdraw the claims 
of Group II, without prejudice. 

Formal Objections 

The Abstract was objected to because it contains more than 150 words. 
5 The Abstract has been amended in accordance with the Examiner's suggestion and 

Applicants respectfully request that the objection be withdrawn. 

The specification has also been amended using the Substitute Specification procedure, 
as indicated in the enclosed marked up version of the original specification. The Amendments 
correct typographical errors. A substitute specification incorporating such changes is also submitted 
10 herewith. No new matter has been introduced. 

Section 112 Rejections 

Claims 2, 14 and 19 were rejected under 35 U.S.C. 1 12, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention. 

15 The Examiner notes that claim 2 recites the limitation "an intersymbol interference 

estimate for a particular assignment can be obtained by evaluating the following equation ..." on 
lines 4-6. The Examiner asserts the language "can be obtained by evaluating the following equation 
..." is not a definite language to indicate whether the "intersymbol interference estimate for particular 
assignment" is necessary to be obtained by the "equation". 

20 The Examiner also asserts that the parameters Zn, L, ii, a~n-L, a~n-l in claim 2 

and the parameters Zn.j, an,j, L, ii,j, a~nj, an-L"j,..., an-1 j , a~n-L"j,..., a~n-l,j in claims 14 and 19 
are not defined. 

Claim 2 has been amended to state "a particular assignment is obtained by evaluating 
the following equation." Claims 14 and 19 have been amended to define the parameters identified 
25 by the Examiner. Applicants believe that these amendments address the Examiner's concerns under 
Section 112, and respectfully request that the rejections under Section 112, second paragraph, be 
withdrawn. 
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Conclusion 



All of the pending claims, i.e., claims 1-38 and 47-59, are in condition for allowance 



and such favorable action is earnestly solicited. 

If any outstanding issues remain, or if the Examiner has any further suggestions for 
expediting allowance of this application, the Examiner is invited to contact the undersigned at the 
telephone number indicated below. 

The Examiner's attention to this matter is appreciated. 

Respectfully submitted, 




Date: May 29, 2003 



Kevin M. Mason 
Attorney for Applicant(s) 
Reg. No. 36,597 
Ryan, Mason & Lewis, LLP 
1300 Post Road, Suite 205 
Fairfield, CT 06824 
(203) 255-6560 
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VERSION MARKED TO SHOW ALL CHANGES 

IN THE ABSTRACT : 
5 Please amend the Abstract as indicated below: 

A method and apparatus are disclosed for improving the processing time of reduced 
complexity sequence estimation techniques, such as reduced state sequence estimation [(RSSE). The 
possible values for the branch metrics in the RSSE are precomputed to permit pipelining and the 

10 shortening of the critical path]. Precomputing the branch metrics for all possible symbol 
combinations in the channel memory makes it possible to remove the branch metrics unit [(BMU)] 
and decision-feedback unit [(DFU)] from the feedback loop, thereby reducing the critical path. [A 
look-ahead branch metrics unit (LABMU) and an intersymbol interference canceller (ISIC) 
precompute the branch metrics for all possible values for the channel memory. At the beginning of 

15 each decoding cycle, a] A set of multiplexers [(MUXs)] select the appropriate branch metrics based 
on the survivor symbols in the corresponding survivor path cells [(SPCs), which are then sent to an 
add-compare-select unit (ACSU)]. The computational load of the precomputations is reduced for 
multi-dimensional trellis codes by precomputing each dimension of the multi-dimensional trellis 
code separately. [Prefiltering techniques are used to reduce the computational complexity by 

20 shortening the channel memory.] A hybrid survivor memory architecture is also disclosed for a 
RSSE for a channel having a channel memory of length L, where the survivors corresponding to the 
L past decoding cycles are stored in a register exchange architecture (REA), and survivors 
corresponding to later decoding cycles are stored in a trace-back architecture (TBA) or REA. 
[register exchange architecture (REA). Symbols are mapped to information bits to reduce the word 

25 size before being moved from the first register exchange architecture (REA) to the trace-back 
architecture (TBA) or the second register exchange architecture (REA).] 



30 
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IN THE CLAIMS: 

Please amend the claims as indicated below: 
Please cancel claims 39-46, without prejudice. 



5 

1 . (Amended) A method for processing a signal [received from a dispersive channel] 
using a reduced complexity sequence estimation technique, [said channel having a channel memory,] 
said method comprising the steps of: 

precomputing branch metrics [for each possible value of said channel memory]; 
10 selecting one of said precomputed branch metrics based on at least one [past] 

decision[s] from at least one corresponding state[s]; and 

selecting a path having a best path metric for a given state. 



2. (Amended) The method of claim 1 , wherein said precomputed branch metrics 
15 [for a transition from channel assignment a under input a n ] is given by: 

^n(z n .fl«.a)=(zn-fl B +«(a)) 2 - 
wherein an intersymbol interference estimate [for a particular channel assignment a = (a rt _ L a„_j ) can 

be] is obtained by evaluating the following equation: 

20 and wherein Zn is the detector input at time instant n, _l is a channel memory length, {/•,), ie [o,..,l] 
are coefficients of the equivalent discrete-time channel impulse response, a n is a channel symbol 
and a ~ ( a t> _r <L-i ) is a sequence of channel symbols . 



3. (Unamended) The method of claim 1, wherein said path metric is an 
25 accumulation of said corresponding branch metrics over time. l 

4. (Amended) The method of claim 1, wherein an appropriate branch metrics 
A n (z n ,a nt p n ) is selected from said precomputed branch metrics X n (z nt a ni S) using the survivor path 

<S n (P„): 

30 A B {z n , a n , p„ ) = sel{/K n (z n a n ,p n }d n {p n )}. 
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wherein A n (z ny a n ,p n ) is a vector containing the branch metrics I„(z rt ,a n ,a), which can occur for a 
transition from state p„ [under input] and which correspond to channel symbol a n ,but [for] different 
channel [assignments] sequences a 4 and wherein d n (p n ) is the survivor sequence leading to state 

Pn- 

5 

5. (Unamended) The method of claim 1, wherein said best path metric is a 
minimum or maximum path metric. 

6. (Amended) The method of claim 1, wherein said reduced complexity 
10 sequence estimation technique is a reduced state sequence estimation [(RSSE)] technique. 

7. (Amended) The method according to claim 6, wherein said reduced state 
sequence estimation [(RSSE)] technique is a delayed decision-feedback sequence estimation 
[(DFSE)] technique. 

15 

8. (Amended) The method according to claim 6, wherein said reduced state 
sequence estimation [(RSSE)] technique is a parallel decision-feedback equalization [(PDFE)] 
technique. 

20 9. (Unamended) The method of claim 1, wherein said reduced complexity 

sequence estimation technique is an implementation of the Viterbi algorithm. 

10. (Unamended) The method of claim 1, wherein said reduced complexity 
sequence estimation technique is an implementation of the M algorithm. 

25 

11. (Amended) The method of claim 1, wherein said [past] decisions from a 
corresponding state[s are based on past symbols from a corresponding survivor path cell (SPC)] is a 
survivor symbol . 

30 12. (Amended) The method of claim 1, wherein said [past] decision[s] from a 

corresponding state[s are based on past decisions from a corresponding add-compare-select cell 
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(ACSC)] is an add-compare-select decision . 

13. (Amended) A method for processing a multi-dimensional [trellis code] signal 
[received from a dispersive channel] using a reduced complexity sequence estimation technique, said 
channel having a channel memory, said method comprising the steps of: 

precomputing [a] one-dimensional branch metrics [for each possible value of said 
channel memory and] for each dimension of the multi-dimensional signal [trellis code]; 

selecting one of said precomputed one-dimensional branch metric based on at least 
one [past] decision[s] from at least one corresponding state[s]; and 

combining said selected one-dimensional branch metrics to obtain a multi- 
dimensional branch metric. 

14. (Amended) The method of claim 13, wherein said one-dimensional branch 
metric in the dimension ; is precomputed by evaluating the following expressions: 

Kj{znJ> a nJ>8j)={zn,j'- a nJ+ S jfajT aild "j j )= ft <J 3 n-iJ > 

wherein [Sj =^ n -Lj^n-\j) * s a particular assignment for the channel state a } =(a n _ L j ,.. y a n _ l j ) in 
dimension j] z„ rj is the detector input, a„ j is channel symbol at time n and a j =(5 n . f ^-,..,5^ ; ) is a 

sequence of channel symbols in dimension j, l is a channel memory length, B is the number of 
dimensions, and ; ie [o,..,L] a _./€ are coefficients of the equivalent discrete-time channel 

impulse response. 

15. (Amended) The method of claim 13, wherein said selection of an appropriate 
one-dimensional branch metrics for further processing with a reduced complexity sequence estimator 
is given by: 

K,j {z„J > a nJ . Pn )= Ml fan J t n.;' ' a n,j }& nJ (fi n )} 

wherein h n j[z n j> a nj) ^ s the vector containing possible one-dimensional branch metrics 
Kj{znj> a nj><Xj) [under input a nJ for different one-dimensional channel assignments] for the same 
channel symbol a n j , but different channel symbol sequences a j and d nJ (p n ) is the survivor 
sequence in dimension j leading to state p n . 
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16. (Amended) The method of claim 13, wherein said [past] decisions] from a 
corresponding state[s are based on past symbols from a corresponding survivor path cell (SPC)] isa 

5 survivor symbol . 

17. (Amended) The method of claim 13, wherein said [past] decision[s] from a 
corresponding state[s are based on past decisions from a corresponding] is an add-compare-select 
[cell (ACSC)] decision . 

10 

18. (Amended) A method for processing a multi-dimensional [trellis code] signal 
[received from a dispersive channel] using a reduced complexity sequence estimation technique, 
[said channel having a channel memory,] said method comprising the steps of: 

precomputing [a] one-dimensional branch metrics [for each possible value of said 
15 channel memory and] for each dimension of the multi-dimensional signal [trellis code]; 

combining said one-dimensional branch metrics into at least two-dimensional branch 

metrics; and 

selecting one of said at least two-dimensional branch metrics based on at least one 
[past] decisions] from at least one corresponding state[s]. 

20 

19. (Amended) The method of claim 18, [wherein said one-dimensional branch 
metric in the dimension j is precomputed by evaluating the following expressions: 

*nj{znj>anj>a J )={z n ,j-a n j+u J fp$ and Ujfp J )=-I l i l fija n _ i j , 

wherein Sj ={a n - L j^-^n-\j) is a particular assignment for the channel state <xj ={a n -Lj>~> a n-\j) m 
25 dimension i l wherein said one-dimensional branch metric in the dimension j is precomputed by 
evaluating the following expressions: 

K](znJ>*nJ.8j)={*n.j ~ a nJ f ";(«;)= "Sf=l fij "n-ij i 

wherein z nJ is the detector input, a nJ is channel symbol at time n_ and a } = [a n _ LJ ,..,a n _ hj ) is a 

sequence of channel symbols in dimension i, l _ is a channel memory length, B_ is the number of 
30 dimensions, and {fr ie [<),.., *Jj_ ye fi...fll are coefficients of the equivalent discrete-time channel 
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impulse response. 

20. (Amended) The method of claim 1 8, wherein said selection of an appropriate 
at least two-dimensional branch metrics corresponding to a particular state and channel symbol 
5 [input] for further processing with a reduced complexity sequence estimator is based on the survivor 
symbols for said state and said at least two dimensions and said selection is performed among [all] 
said precomputed at least two-dimensional branch metrics for said state, [input] channel symbol and 
different previous channel symbol sequences [assignments for said dimensions]. 

10 21. (Amended) The method of claim 18, wherein said [past] decision[s] from a 

corresponding state[s] is a survivor symbol [are based on past symbols from a corresponding 
survivor path cell (SPC)]. 

22. (Amended) The method of claim 18, wherein said [past] decision[s] from a 
15 corresponding state[s] is an [are based on past decisions from a corresponding] add-compare-select 

[cell (ACSC)] decision . 

23. (Unamended) The method of claim 18, further comprising the step of 
combining said selected at least two-dimensional branch metric to obtain a multi-dimensional branch 

20 metric. 

24. (Amended) A method for processing a signal received from a [dispersive] 
channel using a reduced complexity sequence estimation technique, [said channel having a channel 
memory,] said method comprising the steps of: 

25 prefiltering said signal to shorten a memory of said channel [memory]; 

precomputing branch metrics for [each] possible values of said shortened channel 

memory; 

selecting one of said precomputed branch metrics based on [past] at least one 
decisionfs] from at least one corresponding state[s]; and 
30 selecting a path having a best path metric for a given state. 
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25. (Amended) The method of claim 24, wherein said prefiltering step further 
comprises the step of processing less significant taps with a lower complexity cancellation algorithm 
that cancels the less significant taps using tentative decisions and processing more significant taps 

5 with a reduced state sequence estimation [(RSSE)] technique. 

26. (Amended) The method according to claim 24, wherein said lower complexity 
cancellation algorithm is a decision feedback prefilter [(DFP)] technique. 

10 27. (Unamended) The method according to claim 24, wherein said lower 

complexity cancellation algorithm utilizes a linear equalizer technique. 

28. (Amended) The method according to claim 24, wherein said lower complexity 
cancellation algorithm is a soft decision feedback prefilter [(DFP)] technique. 

15 

29. (Unamended) The method according to claim 24, wherein said lower 
complexity cancellation algorithm reduces the intersymbol interference associated with said less 
significant taps. 

20 30. (Unamended) The method according to claim 24, wherein said more 

significant taps comprise taps below a tap number, U, where U is a prescribed number less than L. 

31. (Amended) The method according to claim 24, wherein said reduced 
complexity sequence estimation technique is a delayed decision -feedback sequence estimation 

25 [(DFSE)] technique. 

32. (Amended) The method according to claim 24, wherein said reduced 
complexity sequence estimation technique is a parallel decision-feedback equalization [(PDFE)] 
technique. 

30 
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33. (Amended) The method according to claim 24, wherein said reduced 
complexity sequence estimation technique is a reduced state sequence estimation [(RSSE)] 
technique. 

34. (Unamended) The method according to claim 24, wherein said reduced 
5 complexity sequence estimation technique is an implementation of the Viterbi algorithm. 

35. (Unamended) The method according to claim 24, wherein said reduced 
complexity sequence estimation technique is an implementation of the M algorithm. 

10 36. (Amended) The method of claim 24, wherein said [past] decision[s] from a 

corresponding state[s] is a survivor symbol [are based on past symbols from a corresponding 
survivor path cell (SPC)]. 

37. (Amended) The method of claim 24, wherein said [past] decision[s] from a 
15 corresponding state[s are based on past decisions from a corresponding] is an add-compare-select 

decision, [cell (ACSC).] 

38. (Amended) A method for processing a signal received from a [dispersive] 
channel using a reduced complexity sequence estimation technique, [said channel having a channel 

20 memory,] said method comprising the steps of: 

prefiltering said signal to shorten [said] a channel memory; 
precomputing a one-dimensional branch metric for [each] possible values of said 
shortened channel memory and for each dimension of the multi-dimensional signal [trellis code]; 

combining said one-dimensional branch metric into at least two-dimensional branch 

25 metrics; and 

selecting one of said at least two-dimensional branch metrics based on [past] at least 
one decisionfs] from at least one corresponding state[s]. 



39. (Cancelled) 



30 
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10 



40. (Cancelled) 

41. (Cancelled) 

42. (Cancelled) 

43. (Cancelled) 

44. (Cancelled) 

45. (Cancelled) 

46. (Cancelled) 



15 47 . (Amended) A reduced complexity sequence estimator [for processing a signal 

received from a dispersive channel having a channel memory,] comprising: 

a [look-ahead] branch metrics unit for precomputing branch metrics [for each possible 
value of said channel memory]; 

a multiplexer for selecting one of said precomputed branch metrics based on at least 
20 one [past] decision[s] from at least one corresponding state[s]; and 

an add-compare-select unit for selecting a path having a best path metric for a given 

state. 

48. (Amended) The reduced complexity sequence estimator of claim 47, wherein 
25 said [past] decision[s] from ^corresponding state[s] is taken from the survivor memory unit, [are 

based on past symbols from a corresponding survivor path cell (SPC).] 

49. (Amended) The reduced complexity sequence estimator of claim 47, wherein 
said [past] decision[s] from a corresponding state[s] is taken from the add-compare-select unit, [are 

30 based on past decisions from a corresponding add-compare-select cell (ACSC).] 
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50. (Amended) A reduced complexity sequence estimator for processing a multi- 
dimensional signal [received from a dispersive channel having a channel memory,] comprising: 

a [look-ahead] branch metrics unit for precomputing [a] one-dimensional branch 
metrics [for each possible value of said channel memory and] for each dimension of the multi- 
5 dimensional trellis code; 

a multiplexer for selecting one of said precomputed one-dimensional branch metric 
based on at least one [past] decision[s] from at least one corresponding state[s]; and 

a multi-dimensional branch metric computation unit [cell] for computing a multi- 
dimensional branch metric based on [combining] said selected one-dimensional branch metrics [to 
10 obtain a multi-dimensional branch metric]. 



5 1 . (Amended) The reduced complexity sequence estimator of claim 50, wherein 
said [past] decision[s] from acorresponding state[s] is available in the survivor memory unit, [are 
based on past symbols from a corresponding survivor path cell (SPC).] 

15 



52. (Amended) The reduced complexity sequence estimator of claim 50, wherein 
said [past] decision[s] from acorresponding statefs] is available in the add-compare-select unit, [are 
based on past decisions from a corresponding add-compare-select cell (ACSC).] 

20 

53. (Amended) A reduced complexity sequence estimator for processing a multi- 
dimensional signal [received from a dispersive channel having a channel memory,] comprising: 

a [look-ahead] branch metrics unit for precomputing [a] one-dimensional branch 
metrics [for each possible value of said channel memory and] for each dimension of the multi- 
25 dimensional signal [trellis code] ; 

means for combining said one-dimensional branch metric into at least two- 
dimensional branch metrics; 

a multiplexer for selecting one of said at least two-dimensional branch metrics based 
on at least one [past] decision[s] from at least one corresponding state[s]; and 
30 a multi -dimensional branch metric [cell] unit for combining said selected at least two- 

dimensional branch metric to obtain a multi-dimensional branch metric. 
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54. (Amended) The reduced complexity sequence estimator of claim 53, wherein 
said [past] decisions] from ^corresponding state[s are] is based on a survivor symbol [past symbols 
from] in a corresponding survivor path cell [(SPC)]. 

5 

55. (Amended) The reduced complexity sequence estimator of claim 53, wherein 
said [past] decision[s] from a corresponding state[s are] is based on a [past] decision[s] from a 
corresponding add-compare-select cell [(ACSC)]. 

10 56. (Amended) A reduced complexity sequence estimator for processing a signal 

received from a [dispersive] channel [having a channel memory,] comprising: 
a prefilter to shorten [said] achannel memory; 

a [look-ahead] branch metrics unit for precomputing branch metrics for [each] 
possible values of said channel memory; 
15 a multiplexer for selecting one of said precomputed branch metrics based on at least 

one [past] decisions] from at least one corresponding state[s]; and 

an add-compare-select unit for selecting a path having a best path metric for a given 

state. 

20 57. (Amended) The reduced complexity sequence estimator of claim 56, wherein 

said [past] decision[s] from a corresponding state[s are] is based on a survivor symbol in the 
survivor memory unit, [past symbols from a corresponding survivor path cell (SPC).] 

58. (Amended) The reduced complexity sequence estimator of claim 56, wherein 
25 said [past] decision[s] from ^corresponding state[s are] is based on an add-compare-select decision. 

[past decisions from a corresponding add-compare-select cell (ACSC).] 

59. (Amended) A reduced complexity sequence estimator for processing a multi- 
dimensional signal received from [a dispersive] channel having a channel memory, comprising: 

30 a prefilter to shorten [said] a channel memory; 

a [multi-dimensional look-ahead] branch metrics unit for precomputing [a] one- 
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dimensional branch metricsjbr [each] possible values of said shortened channel memory and for 
each dimension of the multi-dimensional signal [trellis code]; 

means for combining said one-dimensional branch metric into at least two- 
dimensional branch metrics; and 
5 a multiplexer for selecting one of said at least two-dimensional branch metrics based 

on [past] at least one decision[s] from at least one corresponding state[s]. 
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TflOD AND APPARATUS FOR SHORTENING THE CRITICAL PATH OF 
REDUCED COMPLEXITY SEQUENCE ESTIMATION TECHNIQUES 




Marked-Up Specification 



5 



Field of the Invention 



The present invention relates generally to channel equalization and decoding 



techniques, and more particularly, to sequence estimation techniques with shorter critical paths. 
10 Background of the Invention 



conductors have progressively increased from 10 Megabits-per-second (Mbps) to 1 Gigabit-per- 
second (Gbps). The Gigabit Ethernet 1000 Base-T standard, for example, operates at a clock rate 
of 125 MHz and uses category 5 cabling with four copper pairs to transmit 1 Gbps. Trellis- 

15 coded modulation (TCM) is employed by the transmitter, in a known manner, to achieve coding 
gain. The signals arriving at the receiver are typically corrupted by intersymbol interference 
(ISI), crosstalk, echo, and noise. A major challenge for 1000 Base-T receivers is to jointly 
equalize the channel and decode the corrupted trellis-coded signals at the demanded clock rate of 
125 MHz, as the algorithms for joint equalization and decoding incorporate non-linear feedback 

20 loops that cannot be pipelined. 



(MLSE), to produce the output symbols or bits. A maximum likelihood sequence estimator 
[(MLSE)] considers all possible sequences and determines which sequence was actually 
transmitted, in a known manner. The maximum likelihood sequence estimator [(MLSE)] is the 

25 optimum decoder and applies the well-known Viterbi algorithm to perform joint equalization and 
decoding. For a more detailed discussion of a Viterbi implementation of a maximum likelihood 
sequence estimator [(MLSE)], see Gerhard Fettweis and Heinrich Meyr, "High-Speed Parallel 
Viterbi Decoding Algorithm and VLSI-Architecture," IEEE Communication Magazine (May 
1991), incorporated by reference herein. 

30 In order to reduce the hardware complexity for the maximum likelihood sequence 

estimator [(MLSE)] that applies the Viterbi algorithm, a number of sub-optimal approaches, such 
as "reduced state sequence estimation (RSSE)" algorithms, have been proposed or suggested. 



The transmission rates for local area networks (LANs) that use twisted pair 



Data detection is often performed using maximum likelihood sequence estimation 



• • 

For a discussion of reduced state sequence estimation [(RSSE)] techniques, as well as the special 
cases of decision-feedback sequence estimation (DFSE) and parallel decision-feedback 
equalization (PDFE) techniques, see, for example, P. R. Chevillat and E. Eleftheriou, "Decoding 
of Trellis-Encoded Signals in the Presence of Intersymbol Interference and Noise", IEEE Trans. 

5 Commun., vol. 37, 669-76, (July 1989), M. V. Eyuboglu and S. U. H. Qureshi, "Reduced-State 
Sequence Estimation For Coded Modulation On Intersymbol Interference Channels", IEEE 
JSAC, vol. 7, 989-95 (Aug. 1989), or A. Duel-Hallen and C. Heegard, "Delayed decision- 
feedback sequence estimation," IEEE Trans. Commun., vol. 37, pp. 428-436, May 1989, each 
incorporated by reference herein. For a discussion of the M algorithm, see, for example, E. F. 

10 Haratsch, "High-Speed VLSI Implementation of Reduced Complexity Sequence Estimation 
Algorithms With Application to Gigabit Ethernet 1000 Base-T," Int'l Symposium on VLSI 
Technology, Systems, and Applications, Taipei (Jun. 1999), incorporated by reference herein. 

Generally, reduced state sequence estimation [(RSSE)] techniques reduce the 
complexity of the maximum likelihood sequence estimators [(MLSE)] by merging several states. 

15 The reduced state sequence estimation [RSSE] technique incorporates non-linear feedback loops 
that cannot be pipelined. The critical path associated with these feedback loops is the limiting 
factor for high-speed implementations. 

United States Patent Application Serial Number 09/326,785, filed June 4, 1999 
and entitled "Method and Apparatus for Reducing the Computational Complexity and Relaxing 

20 the Critical Path of Reduced State Sequence Estimation [(RSSE)] Techniques," incorporated by 
reference herein, discloses a reduced state sequence estimation [(RSSE)] algorithm that reduces 
the hardware complexity of reduced state sequence estimation [RSSE] techniques for a given 
number of states and also relaxes the critical path problem. While the disclosed reduced state 
sequence estimation [RSSE] algorithm exhibits significantly improved processing time, 

25 additional processing gains are needed for many high-speed applications. A need therefore 
exists for a reduced state sequence estimation [(RSSE)] algorithm with improved processing 
time. Yet another need exists for a reduced state sequence estimation [(RSSE)] algorithm that is 
better suited for a high-speed implementation using very large scale integration (VLSI) 
techniques. 

30 
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Summary of the Invention 

Generally, a method and apparatus are disclosed for improving the processing 
time of the reduced complexity sequence estimation techniques, such as the reduced state 
sequence estimation [RSSE] technique, for a given number of states. According to one feature of 

5 the invention, the possible values for the branch metrics in the reduced state sequence estimation 
[(RSSE)] technique are precomputed in a look-ahead fashion to permit pipelining and the 
shortening of the critical path. Thus, the present invention provides a delay that is similar to a 
traditional optimum Viterbi decoder. Precomputing the branch metrics for all possible symbol 
combinations in the channel memory in accordance with the present invention makes it possible 

10 to remove the branch metrics unit (BMU) and decision-feedback unit (DFU) from the feedback 
loop, thereby reducing the critical path. In the illustrative implementation, the functions of the 
branch metrics unit [(BMU)] and decision-feedback unit [(DFU)] are performed by a look-ahead 
branch metrics unit (LABMU) and an intersymbol interference canceller (ISIC) that are removed 
from the critical path. 

15 A reduced state sequence estimator [(RSSE)] is disclosed that provides a look- 

ahead branch metrics unit [(LABMU)] to precompute the branch metrics for all possible values 
for the channel memory. At the beginning of each decoding cycle, a set of multiplexers 
(MUXs) select the appropriate branch metrics based on the survivor symbols in the 
corresponding survivor path cells (SPCs), which are then sent to an add-compare-select unit 

20 (ACSU). The critical path now comprises one multiplexer [MUX], add-compare-select unit 
[ACSC] and survivor path cell [SPC]. The disclosed reduced state sequence estimator [RSSE] 
can be utilized for both one-dimensional and multi-dimensional trellis codes. 

For multi-dimensional trellis codes where the precomputation of multi- 
dimensional branch metrics becomes computationaly too expensive, a modified reduced state 

25 sequence estimator [RSSE] is disclosed to reduce the computational load. The metrics for each 
dimension of the multi-dimensional trellis code are precomputed separately. The appropriate 
one-dimensional branch metrics are then selected based on the corresponding survivor symbols 
in the corresponding survivor path cell [(SPC)] for that dimension. A multi-dimensional branch 
metrics unit then combines the selected one-dimensional branch metrics to form the multi- 

30 dimensional branch metrics. According to another aspect of the invention, prefiltering 
techniques are used to reduce the computational complexity by shortening the channel memory. 
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An example is provided of a specific implementation for a 1000 Base-T Gigabit Ethernet 
implementation that truncates the postcursor channel memory length to one. 

A novel memory-partitioned survivor memory architecture for the survivor 
memory units in the survivor path cell is also disclosed. In order to prevent latency for the 
5 storage of the survivor symbols, which are required in the decision feedback unit [(DFU)] or the 
multiplexer unit [(MUXU)] with zero latency, a hybrid survivor memory arrangement is 
disclosed for reduced state sequence estimation [(RSSE)]. In a[n] reduced state sequence 
estimator [RSSE] implementation for a channel memory of length L, the survivor symbols 
corresponding to the L past decoding cycles are utilized (i) for intersymbol interference 

10 cancellation in the decision-feedback units [(DFU)] of a conventional reduced state sequence 
estimator [RSSE], and (ii) for the selection of branch metrics in the multiplexers [(MUXU)] in an 
reduced state sequence estimator [RSSE] according to the present invention. The present 
invention stores the survivors corresponding to the L past decoding cycles in a register exchange 
architecture (REA), and survivors corresponding to later decoding cycles are stored in a trace- 

15 back architecture (TBA) or register exchange architecture [(REA)]. Before symbols are moved 
from the register exchange architecture [(REA)] to the trace-back architecture [(TBA)], they are 
mapped to information bits to reduce the word size. In a 1000 Base-T implementation, the 
register exchange architecture [(REA)] is used for the entire survivor memory, as the latency 
introduced by the trace-back architecture [(TBA)] in the second memory partition would lead to 

20 a violation of the tight latency budget specified for the receiver in the 1000 Base-T standard. 



Brief Description of the Drawings 

FIG. 1 illustrates an equivalent discrete time model of a conventional trellis coded 
communications system; 
25 FIG. 2 illustrates a conventional implementation of the Viterbi algorithm; 

FIG. 3 illustrates the architecture for conventional implementation of an reduced 
state sequence estimator [(RSSE)]; 

FIG. 4 illustrates the architecture of a reduced state sequence estimator [(RSSE)] 
with precomputation of branch metrics in accordance with the present invention; 
30 FIG. 5 illustrates the use of multi-dimensional trellis coded modulation for a 

multidimensional channel; 
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FIG. 6 illustrates the architecture for a one-dimensional precomputation for a 
multi-dimensional reduced state sequence estimator [(RSSE)] in accordance with the present 
invention; 

FIG. 7 illustrates the architecture of a reduced state sequence estimator [(RSSE)] 
5 that utilizes prefiltering techniques in accordance with the present invention to shorten the 
channel memory; 

FIG. 8 illustrates a decision-feedback prefilter for a 1000 Base-T Gigabit Ethernet 
implementation that truncates the postcursor channel memory length from fourteen to one; 

FIG. 9 illustrates the look-ahead computation of ID branch metrics by one of the 
10 1D-LABMU units of FIG. 6 for the 1000 Base-T Gigabit Ethernet implementation; 

FIG. 10 illustrates the selection of the ID branch metrics by the multiplexer of 
FIG. 6 for the 1000 Base-T Gigabit Ethernet implementation; and 

FIG. 1 1 illustrates a novel memory-partitioned register exchange network (SPC-n) 
for state one for the 1000 Base-T Gigabit Ethernet implementation. 

15 

Detailed Description 

As previously indicated, the processing speed for reduced complexity sequence 
estimation techniques, such as reduced state sequence estimation [(RSSE)], is limited by a 
recursive feedback loop. According to one feature of the present invention, the processing speed 

20 for such reduced state sequence estimation [(RSSE)] techniques is improved by precomputing 
the branch metrics in a look-ahead fashion. The precomputation of the branch metrics shortens 
the critical path, such that the delay is of the same order as in a traditional Viterbi decoder. 
According to another feature of the present invention, the computational load of the 
precomputations is significantly reduced for multi-dimensional trellis codes. Prefiltering can 

25 reduce the computational complexity by shortening the channel memory. The reduced state 
sequence estimation [RSSE] techniques of the present invention allow the implementation of 
reduced state sequence estimation [RSSE] for high-speed communications systems, such as the 
Gigabit Ethernet 1000 Base-T standard. 

TRELLIS-CODED MODULATION 

30 As previously indicated, reduced state sequence estimation [RSSE] techniques 

reduce the computational complexity of the Viterbi algorithm, when the reduced state sequence 



5 



# 



estimation [RSSE] techniques are used to equalize uncoded signals or jointly decode and 
equalize signals, which have been coded, using trellis-coded modulation [(TCM)]. While the 
present invention is illustrated herein using decoding and equalization of trellis coded signals, the 
present invention also applies to the equalization of uncoded signals, as would be apparent to a 
5 person of ordinary skill in the art. Trellis-coded modulation [TCM] is a combined coding and 
modulation scheme for band-limited channels. For a more detailed discussion of trellis-coded 
modulation [(TCM)], see, for example, G. Ungerboeck, "Trellis-Coded Modulation With 
Redundant Signal Sets," IEEE Comm., Vol. 25, No. 2, 5-21 (Feb. 1987), incorporated by 
reference herein. FIG. 1 illustrates the equivalent discrete time model of a trellis coded 

10 communications system. 

As shown in FIG. 1, information symbols x n consisting of m bits are fed into a 
trellis-coded modulation [(TCM)] encoder 110. The rate m7(m'+i) encoder 110 operates on m' 
input bits and produces m*+i encoded bits, which are used to select one of the 2 m+1 subsets (each 
of size 2 m " m ' ) from the employed signal constellation of size 2 m+1 , while the uncoded bits are 

15 used to select one symbol a n within the chosen subset. In the illustrative implementation, Z - 
level pulse amplitude modulation (Z-PAM) is used as the modulation scheme for the symbols 
a n . The techniques of the present invention, however, can be applied to other modulation 
schemes such as PSK or QAM, as would be apparent to a person of ordinary skill in the art. The 
selected symbol a n is sent over the equivalent discrete-time channel. Assuming a one- 

20 dimensional channel, the channel output z n at time instant n is given by: 

L 

Zn =£ ln+ ™n = £// •««-/ + w n > (1) 

i=0 

where q n is the signal corrupted by intersymbol interference [ISI], {/,}, /e[o,..,L] are the 
coefficients of the equivalent discrete-time channel impulse response (/ 0 =1 is assumed without 
loss of generality), l is the length of the channel memory, and {*>„} represents white Gaussian 

25 noise with zero mean and variance a 2 . 

The concatenation of the trellis coder and channel defines a combined code and 
channel state, which is given by 

Z n = G*„ ;*„-!,,. ...a n -i), (2) 
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where \i n is the code state and a n =(a n - Lt ...,a n - x ) is the channel state at time n . The 
optimum decoder for the received signal is the maximum likelihood sequence estimator 
[(MLSE)] that applies the Viterbi algorithm to the super trellis defined by the combined code and 
channel state. The computation and storage requirements of the Viterbi algorithm are 
5 proportional to the number of states. The number of states of the super trellis is given by: 

T = Sx2 mL , (3) 
where s is the number of code states. 

The Viterbi algorithm searches for the most likely data sequence by efficiently 
accumulating the path metrics for all states. The branch metric for a transition from state 
10 under input a „ is given by: 

Among all paths entering state £ n+1 from predecessor states {% n }, the most likely 
path is chosen according to the following path metric calculation, which is commonly referred to 
as add-compare-select (ACS) calculation: 
15 r({ fl+1 )= ^ (r(g B )+A(z Bffl||> §J). (5) 

An implementation of the Viterbi algorithm is shown in FIG. 2. The Viterbi 
implementation 200 shown in FIG. 2 comprises of a main components branch metric unit 
[(BMU)] 210, an add-compare-select unit [(ACSU)] 220 and a survivor memory unit (SMU) 
230. The branch metric unit [(BMU)] 210 calculates the metrics for the state transitions 

20 according to equation (4). The add-compare-select [ACS] unit (ACSU) 220 evaluates equation 
(5) for each state, and the survivor memory unit [(SMU)] 230 keeps track of the surviving paths. 
The data flow in the branch metric unit [BMU] 210 and survivor memory unit [SMU] 230 is 
strictly feed-forward and can be pipelined at any level to increase throughput. The bottleneck for 
high-speed processing is the add-compare-select unit [(ACSU)] 220, as the recursion in the add- 

25 compare-select [ ACS] operation in equation (5) demands that a decision is made before the next 
step of the trellis is decoded. 

Reduced state sequence estimation [RSSE] techniques reduce the complexity of 
the maximum likelihood sequence estimator [(MLSE)] by truncating the channel memory such 
that only the first K of the l channel coefficients {/,}, ie [i.-.l], are taken into account for the 
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trellis. See, A. Duel-Hallen and C. Heegard, "Delayed decision-feedback sequence estimation," 
IEEE Trans. Commun., vol. 37, pp. 428-436, May 1989, incorporated by reference herein. In 
addition, the set partitioning principles described in P. R. Chevillat and E. Eleftheriou, 
"Decoding of Trellis-Encoded Signals in the Presence of Intersymbol Interference and Noise," 
5 IEEE Trans. Comm., Vol. 37, 669-676 (Jul. 1989) and M.V. Eyuboglu and S. U. Qureshi, 
"Reduced-State Sequence Estimation for Coded Modulation on Intersymbol Interference 
Channels," IEEE JSAC, Vol. 7, 989-995 (Aug. 1989), each incorporated by reference herein, are 
applied to the signal alphabet. The reduced combined channel and code state is given in reduced 
state sequence estimation [RSSE] by 

where is the subset the data symbol belongs to. The number of different subsets j n _ ( is 
given by 2 m < , where m t defines the depth of subset partitioning at time instant n-i. It is 
required that 

m< m K < m K _i < ... < Wj < m . (7) 

15 The number of states in the reduced super trellis is given as follows: 

R = Sx2 m *+ . (8) 

In reduced state sequence estimation [RSSE], the branch metric for reduced state 
p n under input a n takes the modified form: 

K(zn><*n>Pn)=(z n ' a n +«n(Pii)) 2 » ( 9 ) 

20 where: 

Un(Pnh~ Ef.,M^GO (10) 

®n(Pn)=(an-L(Pn\ -><*n-\(Pn)) * s the survivor sequence leading to the reduced state p n and 
«n-/(Pn) ^ the associated survivor symbol at time instant n-i . In equation (10), an intersymbol 
interference TISI1 estimate u{p n ) is calculated for state p n by taking the data symbols associated 
25 with the path history of state p n as tentative decisions. The best path metric for state p„ +1 is 
obtained by evaluating 

rfan+iK rmn (r(pj+ l n (z n ,a n , pj) . (11) 



Reduced state sequence estimation [RSSE] can be viewed as a sub-optimum 
trellis decoding algorithm where each state uses decision-feedback from its own survivor path to 
account for the intersvmbol interference [(ISI)] not considered in the reduced trellis. 

FIG. 3 illustrates the architecture for the implementation of reduced state 
5 sequence estimation [RSSE]. As shown in FIG. 3, the decision-feedback cells (DFC) in the 
decision-feedback unit [(DFU)] 340 calculate R intersvmbol interference [ISI] estimates by 
considering the survivors in the corresponding survivor path cell (SPC) of the survivor memory 
unit [SMU] 330 according to equation (10). Each branch metric cell (BMC) in the branch metric 
unit [BMU] 310 computes the metrics for the b = 2 m ' transitions leaving one state. For each state, 

10 the best path selection is performed in the add-compare-select [ACS] cell (ACSC) according to 
equation (11). In contrast to Viterbi decoding, the decision-feedback cell [DFC], branch metric 
cell [BMC], and survivor path [SPC] cells are in the critical loop in addition to the add-compare- 
select [ACSC] cell. The techniques for parallel processing of the Viterbi algorithm exploit the 
fact that the branch metric computation in equation (4) does not depend on the decision of the 

15 add-compare-select [ACS] function in equation (5). Thus, branch metrics can be calculated for 
k trellis steps in a look-ahead fashion to obtain a k -fold increase of the throughput. Sees G. 
Fettweis and H. Meyr, "High-Speed Viterbi Processor: A Systolic Array Solution," IEEE JSAC, 
Vol. 8, 1520-1534 (Oct. 1990) or United States Patent Number 5,042,036, incorporated by 
reference herein. However, for reduced state sequence estimation [RSSE] techniques, the branch 

20 metric computation in equation (9) depends on the decision of the add-compare-select [ACSC] 
cell in the add-compare-select unit [ACSU] 320, which evaluates equation (11), in the previous 
symbol period, as the surviving symbols in the survivor path cell [SPC] of the survivor memory 
unit [SMU] 330 are needed for the decision-feedback computations in equation (10). Thus, the 
block processing techniques described in G. Fettweis and H. Meyr, referenced above, cannot be 

25 applied to speed up the processing of reduced state sequence estimation [RSSE]. 

PRECOMPUTATION OF BRANCH METRICS 
The critical path in reduced state sequence estimation [RSSE] involves more 
operations than in the Viterbi algorithm. In particular, the branch metric computations in the 
branch metric cell [BMC] can be very expensive in terms of processing time, as euclidean 

30 distances have to be obtained by either squaring or performing a table-lookup to achieve good 
coding gain performance. Also, the evaluation of equation (10) in the decision-feedback cell 
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[DFC] 340-n may have a significant contribution to the critical path. Precompiling all branch 
metrics for all possible symbol combinations in the channel memory in accordance with the 
present invention makes it possible to remove the branch metric unit [BMU] 310 and decision- 
feedback unit [DFU] 340 from the feedback loop. This potentially allows for a significant 
reduction of the critical path in reduced state sequence estimation [RSSE]. 

In principle, the channel state a n ={a n _ L ,..,a n _ ] ) can take u = different values. 
The intersymbol interference [(ISI)] estimates for a particular channel assignment a = (a n _ L> ..,a n _ x ) 
can be obtained by evaluating the following equation: 

u(d)=-^J^n-i- (12) 

It is noted that equation (12) does not depend on the time n and is thus a constant 
for a particular channel assignment a. The speculative branch metric for a transition from 
channel assignment a under input a n is then given by 

X n (z n ,a n ,a)=(z n -a n +Z(af . (13) 

The trellis coder 100 in FIG. 1 defines 2£ = 2 m ' +1 different subsets. Assuming that 
in the case of parallel transitions the best representative in a subset is obtained by slicing, a 
maximum of M =2bxu =2 m ' +1 x2^ m+l ^ L different branch metrics X n (z n ,a n ,a) are possible and have to 
be precomputed. The trellis coder shown in FIG. 1 may not allow all symbol combinations in the 
channel memory a n . Therefore, the number of branch metrics which have to be precomputed 
might be less than M. The actual number of branch metrics which have to be precomputed 
should be determined from the reduced super trellis. 

For the add-compare-select cell [(ACSC)] 320-n, the appropriate branch metrics 
X n (z n ,a n ,p n ) among all precomputed branch metrics X n (z n ,a ny a) are selected by using the survivor 
path d n (p„): 

K kn ><* n ,Pn) = ^'K kn^n > Pn)^n ipn )}• (I 4 ) 

In equation (14), A n (z„,a n ,p„) is a vector containing the 2 mL branch 
metrics X n (z ny a n , a), which can occur for a transition from state p n under input a n for different 

channel assignments a . The selector function in equation (14) can be implemented with a 2 mL to 
1 multiplexer. 
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It is noted that equations (12) and (13) are both independent from the decision in 
the recursive add-compare-select [ACS] function in equation (11). Thus, the precomputations in 
equations (12) and (13) are strictly feed-forward and can be pipelined at any level. Only the 
selection function in equation (14) lies in the critical path in addition to the add-compare-select 
5 cell [(ACSC)] and survivor path cell [(SPC)]. 

The architecture of a[n] reduced state sequence estimation [RSSE] 400 with 
precomputation of branch metrics in accordance with the present invention is shown in FIG. 4. 
The intersymbol interference [(ISI)] canceller (ISIC) 420 calculates all U values which can 
occur for U(d) . Each of these U values is used by a corresponding look-ahead branch metric cell 

10 [BMC (LABMC)] 410-n to calculate 2b speculative branch metrics X n (z n ,a n ,a) . All the M = ibu 
branch metrics precomputed in the look- ahead branch metrics unit [BMU (LABMU)] 410 are 
then sent to the multiplexer [MUX] unit (MUXU) 430. Then, at the beginning of each decoding 
cycle, each multiplexer [(MUX)] 430-n in the multiplexer [MUX] unit [(MUXU)] 430 selects the 
appropriate branch metrics based on the survivor symbols in the corresponding survivor path cell 

15 [SPC] 450-n, which are then sent to the add-compare-select unit [ACSU] 440. Each multiplexer 
[(MUX)] 430-n in the multiplexer [MUX] unit [(MUXU)] 430 takes L past symbols from the 
corresponding survivor path cell [(SPC)] 450-n. The add-compare-select unit [ACSU] 440 and 
survivor memory unit [SMU] 450 may be embodied as in the conventional reduced state 
sequence estimation [RSSE] 300 of FIG. 3. The output of the look-ahead branch metrics unit 

20 [LABMU] 410 is placed in a pipeline register 460. The critical path now comprises of just the 
multiplexer [MUX] 430, add-compare-select [ACSC] cell 440-n, and survivor path cell [SPC] 
PC 450-n. The multiplexer [MUX] 430 selects a branch metric in accordance with equation (14) 
dependent on the symbols in the survivor path cell [SPC] 450-n. Although the number of 
precomputed branch metrics increases exponentially with the channel memory l and the number 

25 of information bits m , this technique is feasible for small m (corresponding to small symbol 
constellation sizes) and short L . 

PRECOMPUTATION FOR MULTIDIMENSIONAL TRELLIS CODES 

Significant coding gains for large signal constellations can be achieved with 
multidimensional trellis-coded modulation [TCM]. FIG. 5 illustrates the use of multi- 

30 dimensional trellis coded modulation for a multidimensional channel. The b -dimensional 
symbol a n = {a n , { ,->a n}B )> where a n is a vector, is sent over the b -dimensional channel with the 
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channel coefficients {/,.,}, ie[o,..,L], je[\..,B] such that the channel output z n = (z B , P .., is a 
vector given as 

ZnJ = ifiJ-*n-iJ+"nJ> .MUtf], (15) 

where K 7 je are b uncorrelated independent white Gaussian noise sources. Z-PAM 

is considered as the transmission scheme for each channel. The following results are valid for 
other modulation schemes as well. Such an equivalent discrete time channel can be found for 
example in Gigabit Ethernet 1000 Base-T over copper, where # = 4 , m = 8,m' = 2,s=8, Z = 5 . See 
K. Azadet, "Gigabit Ethernet Over Unshielded Twisted Pair Cables," Int'l Symposium on VLSI 
Technology, Systems, and Applications, Taipei (Jun. 1999), incorporated by reference herein. 

As the complexity for the precomputation of branch metrics grows exponentially 
with the number of information bits m , there might be cases where the precomputation of multi- 
dimensional branch metrics as shown in FIG. 4 might be too computationally expensive for 
large signal constellation sizes. However, performing precomputations of the branch metrics 
only for the one-dimensional components of the code can significantly reduce the complexity. 

The 1 -dimensional branch metric in the dimension j is precomputed by 
evaluating the following expressions: 

*n.j{znj>«nj>8j)={zn.j ' a nJ ( l6 ) 
"jfaj)=-lilflj*n-ij > (17) 

where Sj =(a n . Lj -,..,a n _ w j is a particular assignment for the channel state ctj =\p n -Lj - -> a n-i j) * n 
dimension j. 

There are v = z L possible 1-dimensional channel assignments a y . For a given 
channel assignment a ; , c inputs a nJ have to be considered to calculate all possible 1- 
dimensional branch metrics X ttJ (z R j 9 a n j 9 aj), where c, C < Z is the number of 1-dimensional 
subsets. Each of these C inputs a n . corresponds to the point in the corresponding subset to which 
[z n j ) has been sliced to after the cancellation of the intersymbol interference according to 

equations (16) and (17). Consequently, considering all b dimensions, a total N = BxCxV 1- 
dimensional branch metrics have to be precomputed. This can be considerably less than the 
number of precomputations necessary for multidimensional precomputations as discussed above 
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in the section entitled "Precomputation of Branch Metrics." In the case of the Gigabit Ethernet 
1000 Base-T, with c = 2 L = \, and Z=5 1- dimensional precomputation yields a total of 
4x2x5 = 40 1-dimensional branch metric computations, whereas multi-dimensional 
precomputation results in 2 3 x2 9 =4096 4-dimensional branch metric computations. 
5 The selection of the appropriate 1-dimensional branch metrics for further 

processing in reduced state sequence estimation [RSSE] is given by: 

Kj {z n j > a nJ > Pn )= sel \^nJ {^nj > <*nj \&nj (pn )} (18) 

where h nj {z njy a nj ) is the vector containing all v possible 1-dimensional branch metrics 

X nj (z nJ> a n j,dj) under input a nJ for different one-dimensional channel assignments a } and 

10 a n j(Pn) is the survivor sequence in dimension j leading to state p n . This can be implemented 

using a v to 1 multiplexer [MUX] compared to the 2 mL to 1 multiplexer [MUX] needed for 
multi-dimensional precomputation (e.g., in the 1000 Base-T example above, 5 to 1 multiplexers 
[MUXs] are required c.f. to 256 to 1 MUXs). After the appropriate ID branch metrics have been 
selected, the multidimensional branch metric is given as 

15 K(Zn^P n )=2%iKjLj^nJ^Pn) (19). 

FIG. 6 illustrates the architecture 600 for 1-dimensional precomputation for multi- 
dimensional reduced state sequence estimation [RSSE]. Each 1D-ISIC 620-n calculates the V 
intersvmbol interference [ISI] cancellation terms H,(a y ). For each of these the 

corresponding 1D-LABMC 610-n precomputes C one-dimensional branch metrics per channel 
20 assignment and dimension in the 1D-LABMU 610. The multiplexer unit [MUXU] 630 selects 
for each state the appropriate one-dimensional branch metrics dependent on the survivor symbols 
in the SPC 660-n. Each multi-dimensional branch metric cell [BMC (MD-BMC)] 640-n 
calculates the multi-dimensional branch metrics by using the selected 1-dimensional branch 
metrics. The critical path now comprises one multiplexer [MUX] 630, multi-dimensional branch 
25 metric cell [MD-BMC] 640, add-compare-select cell [ACSC] 650 and survivor path cell [SPC] 
660. The multi -dimensional branch metric cell [MD-BMC] 640 performs b-\ additions and 
consequently has a minor contribution to the overall critical path, as the number of dimensions B 
is typically low. 

30 
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PREFELTERING 

It has been shown that the complexity for the precomputation of branch metrics 
increases exponentially with the channel memory L. However, using the prefilter 710, shown in 
FIG. 7, can shorten the channel memory. As the equivalent discrete time channel after a 
5 whitened matched filter is minimum-phase, the channel memory can be truncated with a decision 
feedback prefilter (DFP) to low values of L without significant performance loss for reduced 
state sequence estimation [RSSE], as described in E. F. Haratsch, "High-Speed VLSI 
Implementation of Reduced Complexity Sequence Estimation Algorithms With Application to 
Gigabit Ethernet 1000 Base-T," Int'l Symposium on VLSI Technology, Systems, and 
10 Applications, Taipei (Jun. 1999) and United States Patent Application Serial Number 
09/326,785, filed June 4, 1999 and entitled "Method and Apparatus for Reducing the 
. Computational Complexity and Relaxing the Critical Path of Reduced State Sequence Estimation 
(RSSE) Techniques," each incorporated by reference herein. Alternatively, the prefilter 710 
could be implemented as a linear filter, such as those described in D.D. Falconer and F.R. 
15 Magee, "Adaptive Channel Memory Truncation for Maximum-Likelihood Sequence 
Estimation," The Bell Systems Technical Journal, Vol. 52, No. 9, 1541-62 (Nov. 1973), 
incorporated by reference herein. 

Thus, for channels with large channel memories where the precomputation of 
branch metrics is too expensive, a prefilter could be used to truncate the channel memory such 
20 that precomputation becomes feasible. 

1000-BASE T GIGABIT ETHERNET EXAMPLE 
The following is an example of a specific implementation for a 1000 Base-T 
Gigabit Ethernet receiver. For a detailed discussion of the 1000 Base-T Gigabit Ethernet 
standard and related terminology and computations used herein, see, for example, M. Hatamian 
25 et al., "Design considerations for Gigabit Ethernet 1000 Base-T twisted pair transceivers," Proc. 
CICC, Santa Clara, CA, pp. 335-342, May 1998, incorporated by reference herein. 

A decision-feedback prefilter for the 1000 Base-T Gigabit Ethernet 
implementation is shown in FIG. 8. The look-ahead computation of ID branch metrics by one of 
the 1D-LABMU units of FIG. 6 for the 1000 Base-T Gigabit Ethernet implementation is shown 
30 in FIG. 9. FIG. 10 illustrates the selection of the ID branch metrics by the multiplexer of FIG. 6 
for the 1000 Base-T Gigabit Ethernet implementation. Finally, FIG. 11 illustrates the register 
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exchange network (SPC n) for state one for the 1000 Base-T Gigabit Ethernet implementation, 
where an illustrative merge depth of 14 is utilized for the survivor memory unit [SMU]. 
Decision-Feedback Prefilter 

A decision-feedback prefilter 800 that truncates the postcursor memory length on 
5 wire pair j from fourteen to one is shown in FIG. 8. The decision-feedback prefilter 800 
resembles the structure of a decision-feedback equalizer (DFE) as it uses tentative decisions 
obtained by its own slicer to remove the tail of the postcursor channel impulse response. 
Precomputation of ID branch metrics 

As the effective postcursor channel memory is one after the decision-feedback 
10 prefilter 800, the computational complexity for look-ahead precomputations of ID branch 

metrics on each wire pair is modest. The speculative ID branch metric for wire pair j under the 
assumption that the channel memory contains a n _ hj is 

Kj(ynj> a nj> 5 n-lj)= ^ nj ~ <*n,J ~ A A-lJ • ( 20 ) 

As there are 5 possible values for a n j , and as y n . after removal of intersymbol interference has 

15 to be sliced to the closest representative of both ID subsets A as well as 2?, a total of 10 ID 
branch metrics have to be precomputed per wire pair. This is shown in FIG. 9, where the slicers 
910-n calculate the difference to the closest point in ID subset A or B. There is one clock cycle 
time for one addition, slicing, and squaring. It should be noted that the computational complexity 
of precomputing branch metrics increases exponentially with the channel memory. If the channel 

20 memory were two, 50 ID branch metrics would have to be precomputed per wire pair, and for a 
channel memory of three this number would increase to 250. 
Selection of ID Branch Metrics 

The multiplexer unit [MUXU] 630 selects for each wire pair j and code state p n 
the appropriate ID branch metrics corresponding to subsets A and B based on the past survivor 
25 symbol a n _i j(p n ). This is done with 5:1 multiplexers [MUXs] 1010 as shown in FIG. 10. In 

total, 64 such multiplexers are needed. 

Computation of 4D Branch Metrics 

The 4D-BMU 640 adds up the ID branch metrics to calculate the 4D branch 
metrics corresponding to state transitions in the trellis. The 4D-BMU 640 is in the critical loop. 
30 Bringing the 4D-BMU 640 out of the critical loop by look-ahead precomputations of 4D branch 
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metrics would be impractical in terms of computational complexity, as shown in the example 
discussed above in the section entitled "Precomputation of Multi-Dimensional Trellis Codes." It 
can be easily seen that there are too many possibilities, which must be considered. 
Add-Compare-Select 

5 For each state, a 4-way add-compare-select [ACS] has to be performed. To speed 

up the processing, the architecture proposed in P.J. Black and T.H. Meng, "A 140-Mb/s, 32- 
state, radix-4 Viterbi decoder," IEEE JSSC, vol. 27, pp. 1877-1885, Dec. 1992, has been chosen, 
where the minimum path metric among the 4 candidates is selected by 6 comparisons in parallel. 
State metric normalization is done using modulo arithmetic, See, A.P. Hekstra, "An Alternative 
10 To Metric Rescaling In Viterbi Decoders", IEEE Trans. Commun., vol. 37, pp. 1220-1222, Nov. 
1989. 

Survivor Memory 

In Viterbi decoding, usually the trace-back architecture [(TBA)] is the preferred 
architecture for the survivor memory as it has considerably less power consumption than the 

15 register exchange architecture [(REA)]. R. Cypher and C.B. Shung, "Generalized Trace-Back 
Techniques For Survivor Memory Management In The Viterbi Algorithm," Journal of VLSI 
Signal Processing, vol. 5, pp. 85-94, 1993. However, as the trace-back architecture [(TBA)] 
introduces latency it cannot be used to store the survivor symbols, which are required in the 
decision-feedback unit [DFU] or multiplexer unit [MUXU] with zero latency. Thus, a hybrid 

20 survivor memory arrangement seems to be favorable for a reduced state sequence estimation 
[(RSSE)] implementation for a channel of memory length L. The survivors corresponding to the 
L past decoding cycles are stored in a register exchange architecture [(REA)], and survivors 
corresponding to later decoding cycles in a trace-back architecture [(TBA)]. Before symbols are 
moved from the register exchange architecture [(REA)] to the trace-back architecture [(TBA)], 

25 they are mapped to information bits to reduce the word size. However, in 1000 Base-T the 
register exchange architecture [(REA)] must be used for the entire survivor memory, as the 
latency introduced by the trace-back architecture [(TBA)] would lead to a violation of the tight 
latency budget specified for the receiver in the 1000 Base-T standard. Likewise, symbols 
moved from the first register exchange architecture [(REA)] to the second register exchange 

30 architecture [(REA)] are mapped to information bits to reduce the word size. 
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The survivor memory architecture is shown in FIG. 11, where only the first row 
corresponding to state one is shown. SX n (p n ) denotes the decision for 4D subset SX for a 

transition from state p n (for definition of 4D subsets see, Hatamian et al.), b n ^{p n ) are the 8 

information bits which correspond to the 4D survivor symbol a n _ ( (p„) and d n {\) is the 2-bit 

decision of the add-compare-select [ACS] for state one. As the channel memory seen by the 
reduced state sequence estimation [(RSSE)] is one, only the first column stores 4D symbols, 
which are represented by 12 bits and are fed into the multiplexer unit [MUXU]. After this first 
column, the survivor symbols are mapped to information bits and then stored as 8 bits. For a 
merge depth of 14, this architecture needs 928 REGs compared to 1344 REGs in a[n] survivor 
memory unit [SMU] which does not apply the hybrid memory partition, where all decisions are 
stored as 12 bit 4D symbols. 

It is to be understood that the embodiments and variations shown and described 
herein are merely illustrative of the principles of this invention and that various modifications 
may be implemented by those skilled in the art without departing from the scope and spirit of the 
invention. 
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